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We consider a single-server cyclic polling system with three queues where the 
server follows an adaptive rule: if it finds one of queues empty in a given cycle, 
it decides not to visit that queue in the next cycle. In the case of limited service 
policies, we prove stability and instability results under some conditions which 
are sufficient but not necessary, in general. Then we discuss open problems with 
identifying the exact stability region for models with limited service disciplines: 
we conjecture that a necessary and sufficient condition for the stability may 
depend on the whole distributions of the primitive sequences, and illustrate that 
by examples. We conclude the paper with a section on the stability analysis of 
a polling system with either gated or exhaustive service disciplines. 
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1 Introduction 

A standard polling model is a single-server system where the server visits a finite 
number of queues in cyclic order. The stability and performance analysis of polling 
models with cyclic and other scheduling policies has been a very popular research 
topic for several decades. See, e.g. Borst (1995); Boxma et al. (2009); Wierman et 
al. (2007); Winands et al. (2009) and the lists of references therein for the progress 
in the studies of polling models. One of the key tools in the modern stability analysis 
of queueing networks is the fluid limit approach. See, e.g., Chen and Mandelbaum 
(1991); Rybko and Stolyar (1992); Stolyar (1995); Dai (1995); Dai and Meyn (1995); 
Down (1996) for the detailed description. This approach involves the use of the 
functional strong law of large numbers and works perfectly well if one can identify all 
the limiting parameters/functions there. This holds, in particular, for models where 
the server's scheduling is state-independent. 
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In this paper, we make an attempt to study a model with an adaptive scheduling 
of the server's visits to queues. Namely, we consider a model with 3 queues and a 
cyclic policy, but assume in addition that if in some cycle the server finds queue 2 
empty, it does not visit this queue in the next cycle. This may make sense if one 
assumes, in addition, that the direct walking time from queue 1 to queue 3 is smaller 
than that via queue 2. We consider three types of server's policies/disciplines in 
queues: limited, gated and exhaustive. We were motivated by the paper Vishnevsky 
and Semenova (2008) where the authors considered a general model with many queues 
and proposed a numerical iterative scheme to calculate the mean waiting time. They 
showed numerically that, in the case of limited service disciplines, the stability region 
may become bigger by implementing such an adaptive scheduling. 

Our original intention was to bring a mathematical accuracy here and to obtain, 
for the proposed scheme, some necessary and sufficient conditions for the stability 
which are better than those in non-adaptive schemes. We planned to use the fluid 
limit approach for the stability. However, we have completed only a part of our 
programme. First, we derived the evolution differential equations for the fluid limits. 
Then we got two types of results. 

When the service discipline in each queue is either gated or exhaustive, the exact 
stability region is derived. The stability region in this case is the same as for the 
standard non-adaptive schemes, and the stability analysis here is a straightforward 
application of the techniques developed, say, in Dai (1995) and Dai and Meyn (1995). 
So, a possible advantage of the use of adaptive scheduling is not in the stability, but in 
the performance: when the polling systems are stable, stationary characteristics under 
the adaptive schemes may be smaller than those under the non-adaptive schemes. 

If the server discipline in each queue is limited, then we can derive tight fluid 
model equations only in the case where the service discipline in the second queue is 
1-limited. For a general limited discipline, we use simple bounds for a fluid model 
equation to obtain separately sufficient conditions for stability and for instability. 

It is known that a sample-path analysis of fluid limits may become inefficient due 
to several reasons. One of them was discussed, for example, by Foss and Kovalevskii 
(1999) who considered fluid limits as weak limits of stochastic processes under the 
linear scaling in time and in space and show, in particular, that these limits may stay 
random. We will discuss another reason for the limitation of the fluid limit approach 
which is observed in the polling models: a stability region may depend on the entirely 
whole distribution of driving sequences. We believe that the gap between the stability 
and instability conditions is not just a technical limitation of the fluid approximation, 
but indicates that the conditions obtained are as sharp as one could get based only on 
the knowledge of the first moments. We guess that, for any set of parameters in the 
gap, one may propose a system that is stable and another system that is unstable. 

The remainder of this paper is organized as follows. In Section [2l we provide a 
detailed description of the polling system and of the underlying Markov process. Then 
we present the main results of the paper on stability and instability of the system. In 
Section [3j we introduce fluid limits for the system with limited service policies, derive 
dynamical fluid equations and recall known stability and instability criteria via fluid 
limits. Then we prove in Section H] the main results, in the case of limited service 
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policies. Section [5] presents simulation results and a discussion on applicability and 
accuracy of the fluid model approach for (in)stability of polling systems with adaptive 
routing and limited service disciplines. In Section El we study a fluid model for gated 
and exhaustive service disciplines and prove the main theorems in this case. 

2 Model Description and main results 

We consider a polling system with three infinite-buffer queues/ stations and a single 
server. The input stream to queue k — 1, 2, 3 is described by interarrival times Tfc(n) 
between nth and (n + l)st customers, n = 1,2,...; and nth customer in queue k 
requires <7fc(n) units of time for service. The server visits queues in a cyclic order. 
We assume that the cycles start from queue 1, and that there are two possible cycle 
types: 

• standard cycle: 1 — > 2 — > 3 — > 1; 

• reduced cycle: 1—^3—^1. 

A choice of the type of the next cycle on the base of the current cycle information is 
decribed in detail later on. In short, the server may decide not to visit queue 2 in the 
next cycle if it finds that queue empty. 

The nth walking (switch-over) time from station k to station (k + l)(mod3) is 
denoted by £&(n), while walking times from station 1 to station 3 are £4(71). 

A service discipline describes the number of customers that (may be) served during 
a single visit of the server to a queue. We will assume that the service disciplines in 
all queues are the same and belong to one of the following three classes: 

1. limited: upon a visit to queue k — 1, 2, 3, the server serves at most Ik > 
1 customers, i.e. it continues working until either a predefined number Ik of 
customers is served or until the queue becomes empty, whichever occurs first; 

2. gated: upon a visit to a queue, the server serves all the customer that are present 
at the moment of the arrival, and only those customers; 

3. exhaustive: the server continues to serve customers in a queue until the queue 
becomes empty. 

Now we describe inductively the way how does the server choose a type of the next 
cycle. Here the state of queue 2 (empty or not) within a cycle plays a crucial role. 

• The first cycle is of the standard type. 

• If cycle n is of the standard type, and 

— if, within this cycle, the server finds queue 2 non-empty and proceeds with 
the service there, then cycle n + 1 is again standard; 

— if queue 2 is empty, the cycle n + 1 is reduced. 



3 



• If cycle n is reduced, then cycle n + 1 is standard. 

Stochastic Assumptions: We assume that all sequences of random variables intro- 
duced above are mutually independent and that each of these sequences is i.i.d., with 
a finite first moment. We introduce arrival and service rates at each queue as 

Er fc (l) E(T fe (l) 
Let = Ajt///fe, and p = Z)fc=i A- Further, we introduce switch-over rates as 

"* = iS(i)' * = >.-.•«• 

Then ( = Ei =1 ^fc 1 * s the mean switch-over time in the standard cycle, and (* — 
z/3" 1 + v^ 1 is the mean switch-over time in the reduced cycle. We assume that 

C > C* (2.1) 

which makes sense: the server may decide to skip its visit to queue 2 if this may 
decrease the cycle time. 

Representing Markov process: We use 

X(t) = (Q(t), A{t), Bit), B°(t), H{t), lit), C{t)) 

to denote the state of our polling system at time t. The components are described 
below: 

• Q(t) = {Qi{t),Q2{t),Qz{t)), where Qi(t) is the total number of customers that 
are either waiting in queue i or being served at station i at time t. 

• A(t) = (Ai(t) , A 2 (t) , A 3 (t)) , where A^t) is the remaining interarrival time of 
the arrival process to queue % at time t. 

• Bit) is the remaining service time of a customer who is being served at time t 
if the server is in service (and B(t) = if the server is walking at time t). 

• B°{t) is the remaining walking time of the server at time t, if the server is 
walking (and B°(t) = if the server is in service). 

• If the server is in service at time t, Hit) is the station the server works at. If 
the server is walking at time t, Hit) is the station the server is walking to. 

• I(t) takes values and I. It switches from to 1 at the moment when the 
server arrives at queue 2 and finds it empty, and, vise versa, from 1 to when 
the server starts its walking from queue 1 to queue 3 in a reduced cycle. 
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• C(t) is an additional parameter at time t that makes X(t) a Markov process. If 
the server is in service at time t, then C(t) is the number of service completions 
at queue H(t) by time t during the current visit to the queue, for limited service 
disciplines; and the number of arrivals at queue H(t) by time t during the current 
visit to the queue, for gated service disciplines. In both cases we let C(t) = 
when the server is walking. In the case of exhaustive disciplines, we do not need 
an extra parameter, so let C(t) = 0. 

The processes X = {X(t) : t > 0} are taken to be right- continuous with left limits. 
It follows from Dai (1995) that X is a strong Markov process whose state space S is 
a subset of IR+ 1 . 

The Markov process X is said to be positive Harris recurrent if it possesses a 
unique stationary distribution. To state the main results of this paper, we make the 
following assumptions on the interarrival time distributions. For each k — 1, 2, 3, we 
assume that the distribution of random variable Tfc(l) has an unbounded support, i.e., 
P(Tfc(l) > t) > 0, for all t > 0. Further, we assume that, for each k = 1, 2, 3, the 
distribution of Tjt(l) is spread-out, i.e., there exists an integer n > and a non-negative 
function g(x) with J °° g(x) dx > 0, such that 

' n \ f b 

a < r k (i) < b J > / g(x) dx, for any < a < b. 
k i=i J J a 

We say that a polling system is stable if the underlying Markov process is positive 
Harris recurrent, and unstable, otherwise. An unstable polling model is transient if 
\Q(t)\ —> oo a.s., as t — > oo. 

The following theorems provides sufficient conditions for stability, instability and 
transience of the polling systems under consideration. 

Theorem 1. A polling system with limited service disciplines is stable if the following 
three conditions hold: 

Po + ^C < 1, (2.2) 



I 
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Po + min(^^ + A 2 ^, £C) < 1, (2-3) 
Po + min(>^ + A 2 ^, £C) < I- (2-4) 



h 2 2 ' h 

A polling system with either gated or exhaustive service disciplines is stable if p < 1. 

Theorem 2. A polling system with limited service disciplines is unstable if at least 
one of the following three inequalities hold, either 

(2.5) 

1-2 

. Ai C + C* 

Po I 2~ 1 ~ ~ ' ° r ^ ' 

h 



Po + 


A, 


> 


1, or 


A 2 C- 


-c 
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1, or 
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A 2 C- 
h 


-c 

2 


> 


1. 



Po + 1 7T~ + 1 7T~ ^ L (2- 7 ) 
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Moreover, the system is transient if one of the inequalities above is strict. 

A polling system with either gated or exhaustive service disciplines is unstable if 
Po > 1; an d transient if po > 1. 

In two particular cases, the statements of Theorems [T] and [2] do match: 

Corollary 1. A polling system with limited service disciplines and with I2 = 1 is 
stable if and only if 112.2]) , 112.3]) and \2.4\ ) are satisfied. 

A polling system with gated or exhaustive service disciplines is stable if and only if 
Po < 1- 

3 The fluid model and (in) stability criteria — Lim- 
ited service disciplines 

In this section, we consider a polling system with limited service disciplines. We 
define fluid limits and derive fluid model equations that are satisfied by fluid limits. 
Stability and instability criteria are given via the fluid model defined by the fluid model 
equations. In our construction of the fluid model, we follow the general scheme, see 
e.g. Chen and Mandelbaum (1991); Rybko and Stolyar (1992); Stolyar (1995); Dai 
(1995); Dai and Meyn (1995); Down (1996). 

First we define processes related to our polling system. 

• T(t) = (Ti(t),T 2 (t),T 3 (t)), t > 0, where T k (t) is the amount of time the server 
spends in service at station k during the time interval [0, t]. 

• U(t) = {U x {t),U 2 {t),U z {t),Ut{t)), t > 0, where U x {t) (U 2 (t) , U 3 {t) , and U 4 (t), 
respectively) is the amount of time the server spends walking from station 1 to 
2 (2 to 3, 3 to 1, and 1 to 3, respectively), during [0, t]. 

Let X = {(Q(t), T(t), U{t)) : t > 0}. If the initial state x G S of the Markov process 
X is needed to be displayed explicitly, X x is used for the process X obtained with the 
initial state x of the Markov process X. 

By the strong law of large numbers, for almost all sample paths u, we have 

1 - 1 

lim - } T k (i,u) = -, k = 1,2,3, (3.1) 

i=l 

1 n 1 

lim — > e>fc(i, uj) = — , A; = 1,2, 3, (3.2) 

1 n 1 
Hm - V6(i,w) = - , k = 1,2,3,4. (3.3) 

n-j-oo n ' Vk 
1=1 

It follows from the same argument as in Dai (1995) that for every sample path 
us satisfying (I3.ip -( 13T3|) and every collection {x r : r > 0} of initial states such 
that {\x r \/r : r > 0} is bounded, there exists a subsequence r n — > 00 such that 
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■^-\ Xrn (?v, u) converges uniformly on any compact subset of [0, oo) to some limit 
say X = (Q(-),T(-),U(-)). Each such limit X is called a fluid limit. In the special 
case where the sequence of initial states {x r : r > 0} is independent of r, we call the 
limit a fluid limit with fixed initial state. Both types of fluid limits are used in our 
subsequent stability analysis. 

It is known (see, e.g., Bramson (1998)) that, in the analysis of stability via fluid 
limits, it is sufficient to consider the so-called undelayed fluid limits only, i.e. limits 
that satisfy the assumption 

lim -{\a r \ +b r + b° r ) = 0, (3.4) 

r—KX> f 

where a r , b r and b° T are subvectors of the initial state x r = (q ri a ri b ri b° Tl h ri i ri c r ). 
From now on, we consider only undelayed fluid limits. 

If X is a fluid limit obtained from a sequence of initial states {x r } satisfying f)3.4p . 
then all of Qk(-), k = 1,2,3, Tfc(-), k = 1,2,3, and £/&(-), k = 1,2,3,4, are Lipschitz 
continuous functions. Hence they are absolutely continuous and thus differentiable 
almost everywhere with respect to the Lebesgue measure. We say that t is a regular 
point of X if all components of X are differentiable at t. In the rest of the paper, we 
implicitly assume that t is a regular point whenever the derivative of a component of 
X is involved. 

The following theorem presents equations that are satisfied by the fluid limits. 

Lemma 1. For every fluid limit X(t) = (Q(t),T(t),U(t)) , the following equations 
hold: 

Quit) = fc (0) + X k t - /i k f k (t), k = 1, 2, 3, t > 0; (3.5) 
Qk(t) > 0, k = 1,2,3, t > 0; (3.6) 
Tfc(-) and Uj(-) are nondecreasing, k = 1,2,3, j = 1,2,3,4; (3.7) 

3 4 

^2f k (t) + ^2tj j (t)=t, t>0; (3.8) 

fc=l j=l 

v 1 U 1 (t) = v 2 U 2 (t), t>0; (3.9) 
^U 3 (t) = ViUx{t) + u 4 U A (t), t > 0; 



iSiU[(t) + is 4 U' 4 (t)>^Tl(t), t>0; 
^2W>7^(t), t>0; 

y^(t) < ViU'x(t) - u 4 U' 4 (t) < fi 2 f^t), t > 0; 
IfQi(t) > 0, then ViU[(t) + vjj'^t) = ^f[(t), t > 0; 
#Qa(t) > 0, then U' 4 (t) = and u 2 U 2 (t) = y^(t), t > 0; 
IfQ 3 (t) > 0, then u 3 U' 3 (t) = ^(t), t > 0. 

'3 



3.10) 
3.11) 

3.12) 

3.13) 

3.14) 

3.15) 

3.16) 

3.17) 
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Proof. All equations in the theorem are obtained through the standard procedure. 
We provide below proofs only for equations (13.101) , (13. lip , (I3.14p and (13.151) , and omit 
all other proofs. Let 

• D{t) = (D 1 (t), D 2 (t), D 3 (t)), where Di(t) is the number of service completions 
at station i by time t] 

• M(t) = (Mi(t), M 2 (t), M 3 (t)), where M,(t) is the number of service completions 
at station i if the server spends t units of time working at station i; 

• E(t) = (E 1 (t),E 2 (t),E 3 (t),E 4 (t)), where E 1 (t) (E 2 (t), E 3 (t), and E 4 (t), respec- 
tively) is the number of switch-over completions from station 1 to station 2 
(from 2 to 3, from 3 to 1, and from 1 to 3, respectively) by time t; 

• N(t) = (JV!(t),iV 2 (t),iV 3 (t),iV 4 (*)), where N^t) (N 2 (t), N 3 (t), and jV 4 (t), re- 
spectively) is the number of switch-over completions from station 1 to station 2 
(from 2 to 3, from 3 to 1, and from 1 to 3, respectively) if the server spends t 
units of time walking from station 1 to station 2 (from 2 to 3, from 3 to 1, and 
from 1 to 3, respectively). 

Then 

Di{t) = M(Ti(t)), t>0,i = 1,2,3, (3.18) 
Ei(t) = N(Ui(t)), t>0, i = l,2,3,4, (3.19) 

and (H£25 and imply 

lim MiSQ. = ^1 = 12,3, (3.20) 

t->oo t 

lim — ^ = Ui, i = 1,2,3,4. (3.21) 

t— >oo t 

Now we prove fl3~T0|) . fl3~TT|) . (13141) and (l3~T5l) . 

• flBTTO]) : Since \E x {t) + £? 4 (*) - E 3 (t)\ < 1, (gJSD yields 

liViCC/xCt)) + AT 4 (C/ 4 (f)) - 7V 3 (C/ 3 (t))| < 1. 
Applying fluid limits to the above equation, we obtain ( 13. 10[) with the help of 

dS2U). 

• fl3~TT|) : For < t x < t 2 , we have 

D 1 (t 2 ) - D 1 (t 1 ) 



E x {t 2 ) - Ei(h) + E 4 (t 2 ) - E A {h) + 1 > 



h 

Substituting (I3.18P and (13.191) into the above equation yields 

Mi(Tx(t 2 )) — Mx(Tx(ti)) 



iVi(?7i(t 2 ))-iV 1 (f/ 1 (t 1 ))+iV 4 (?7 4 (t 2 ))-iV 4 (?7 4 (t 1 ))+l > 



h 



Applying fluid limits to the above equation, we obtain (13. lip with the help of 
(KM and (E2U). 
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(13.140 : Recall that if no customer is served at station 2 during a standard cycle, 
then the next cycle is reduced. Conversely, if at least one customer is served at 
station 2 during a standard cycle, then the next cycle is standard. Therefore, for 
< t\ <t 2 , the number of cycles with at least one service completion at station 
2 during (t u t 2 ) differs at most by 1 from {E x {t 2 ) - E 1 (t 1 )) - (E 4 (t 2 ) - E 4 {tx)). 
Therefore 

(Eiih) - E 1 (t 1 )) - (E 4 (t 2 ) - E 4 {t x )) - 1 

< D 2 (t 2 ) - Di(ti) 

< UiE^h) - E 1 (t 1 )) - (E 4 (t 2 ) - E 4 (h)) + 1). 

Substituting (13.180 and ( 13.190 into the above equation and applying fluid limits 
yields (13TT41 . 

(13~T5|) : Let < t x < t 2 . If Q x {t) > for all t G (t u t 2 ), then 

Dt{t 2 ) - D^h) 



E x {t2) - ^i(ti) + E 4 (t 2 ) - £ 4 (ti) - 



< 1. 



h 

Hence if Qi(t) > for all t e (ti,t 2 ), then 

Mi(Ti(t 2 )) — Mi(Ti(ti)) 



iVi(^i(t 2 ))-iV 1 (f/ 1 (t 1 ))+iV 4 (f/ 4 (t 2 ))-iV4(?74(ti))- 



< 1. 



h 

Applying fluid limits to the above equation, we obtain (13.150 . 

□ 

We call the equations ( I3.50 -( 13~T70 the fluid model equations and call a solution 
X = {(Q(t),T(t), U(t)) : t > 0}, of the fluid model equations a fluid model solution. 
Note that any fluid limit with fixed initial state necessarily has Q(0) = 0. Thus 
these fluid limits form a subset of fluid model solutions with Q(0) = 0. The following 
definitions and lemmas indicate the usefulness of different types of fluid limits. 

Definition 1. (i) The fluid model is stable if there exists a 5 > such that for each 
fluid model solution X with \Q{0)\ < 1, Q(t) = for t > 5. 

(ii) The fluid model is weakly unstable if there exists a 5 > such that, for each 
fluid model solution X with Q(0) = 0, Q(S) ^ 0. 

The reasoning used in Dai (1995,1996), can be applied easily to our polling system 
to obtain the following criteria. 

Lemma 2. (Dai (1995)) If the fluid model is stable, then the stochastic polling system 
is stable too. 

Lemma 3. (Dai (1996)) If the fluid model is weakly unstable, then the stochastic 
polling system is transient. 
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We present now a weaker instability criterion than Lemma |3j by applying to our 
polling systems the arguments first introduced in Dai et al. (2007), see Lemma [5] 
below. If we assume a priori that the process X is positive Harris recurrent, then 
any fluid limit with fixed initial state must obey an extra dynamical equation, which 
augments the fluid model equations presented in 03.5I) - 03.17I) . Let Fi(t) be the number 
of server's visits to station i when it is empty, in the time interval (0,t). By the 
theory of Markov regenerative processes, if X is positive Harris recurrent, then there 
are positive numbers fi, i = 1,2, 3, such that 

Fit) 

lim-^ = fi, t = l,2,3, (3.22) 

with probability 1. 

Lemma 4. Suppose that the Markov process X is positive Harris recurrent, and a 
fluid limit with fixed initial state X(i) = (Q{t),T(t),U(t)) is driven from a sample 
path u that satisfies ( Iff. 2S\) . Then the following inequalities hold: For t > 0, 

^UiW + ujj'tit) > Y-f[{t); (3.23) 

n 

v 2 U' 2 {t) > ^n(t); (3.24) 
h 

v 3 U>(t) > 7^(t). (3.25) 

Proof. We have 

Diih) - D 1 {t 1 ) < hdEiih) - E^h)) + (E 4 (t 2 ) - E 4 (h)) - (Fi(* 2 ) - F^h)) + 1), 
D 2 {t 2 ) - D 2 {t{) < l 2 ((E 2 (t 2 )-E 2 (t 1 ))-(F 2 (t 2 )-F 2 (t 1 )) + l), 
D 3 (t 2 ) - D 3 (h) < hdE^-E^-iF^-Fsih^ + l). 



Substituting 03.181) and 03.191) into the above equations and applying fluid limits leads 
to 



//2^(t) < l 2 {v 2 U' 2 {t)-f 2 ), 

^(t) < l 3 (ls 3 U' 3 (t)-f 3 ). 

Since f > 0, i = 1, 2, 3, Lemma H] is proved. □ 

We call the union of two systems of equations and inequalities (I3.5p - 03.17p and 
03.23p - 03.25p the augmented fluid model equations and call a solution X, to these 
union an augmented fluid model solution. 

Definition 2. The augmented fluid model is weakly unstable if there exists a 5 > 
such that for each augmented fluid model solution X, with Q(0) = 0, Q(5) ^ 0. 

Suppose that the augmented fluid model is weakly unstable but the Markov process 
X is positive Harris recurrent. Since the augmented fluid model equations are satisfied 
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by every fluid limit which is a limit of scaled sample paths with fixed initial state, 
the argument in Dai (1996) implies that the process is transient in the sense that, 
|<3(t)| — > oo as t — > oo with probability 1, which is a contradiction. Therefore we 
obtain the following instability criterion. 

Lemma 5. (Dai et al. (2007)) If the augmented fluid model is weakly unstable, then 
the stochastic system is unstable. 



4 Proof of Theorems [T] and [2] for limited service 
disciplines 

For a polling system with limited service disciplines, Theorems [1] and |2] follow from 
Propositions [1], [2] and [3] below and the (in) stability criteria, Lemmas [2j [3] and [5j 

Proposition 1. For the polling system with limited service disciplines, the fluid model 
is stable if 112.2}) . i2.$) and {2.J$ are satisfied. 

Proposition 2. For the polling system with limited service disciplines, the augmented 
fluid model is weakly unstable if Ii2.5\) . \2.6) or \2. 7\ ) holds. 

Proposition 3. For the polling system with limited service disciplines, the fluid model 
is weakly unstable if at least one of the inequalities l\2.5\) . \2.0) or {2. 7| ) is strict. 

The remainder of this section is devoted to the proof of Propositions [H [2] and EJ 
For a fluid model solution X, let 

J(t) = {k e {1, 2, 3} : Q fc (t) > 0}, t> 0. (4.1) 

Lemma 6. For each fluid model solution X ; if Q2{t) > 0, then 

m = <L iZg±gggft ,- eJ(t) . (4.2) 

Proof. Let X be a fluid model solution. Suppose that Q2(t) > 0. If Qjif) > 0, then, 
according to flO}, O, (l3TT0ll and ( l3T5l) -( l3~T7l) . we have 

U' k (t) = ^~f;(t), k = 1,2,3, 



kffl®, ke.J(t), 



k , ke{l,2,3}\J(t). 

Substituting the above equations into (13. 8 p yields (14. 2p . □ 
Lemma 7. For each fluid model solution X ; if Q2{t) = 0, then 



to -2~ + 2^fceJ(t) — k 

m £ ± - ; -. + E teJ( ,)ft j( _ J(t) (44) 



to C + Efc e j( ti ,,, 
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Proof. Let X be a fluid model solution. Suppose that Q2{t) = 0. According to (13. 5p . 
fl3T9|) . ( EDD and f l3~T5|) -f l3TTj) . we have 

2*(t) = l ±^-f'At), if Q,(t) > and /c G J(t), (4.5) 

7*(f) = p k , if fc €{1,2,3} \J(t). (4.6) 

Clearly, for any fixed k, the right-hand side in (14.51) is the same for all j with Qj(t) > 0. 
According to (l3T9l- (l3~T3j) and (l3TT5|) - (l3~T7l) . we have 

4 

J2u' k (t) = ^(*)C-^(*)(C-0, if > 0. (4.7) 
fc=l J 

By dS2D, dSZHD-dSZHD and (g2D, 

E^(*) ^ ^'W^ + a 2 ^, if >o, (4.8) 

fc=l •? 

4 

£ff*(*) ^ r^wc. if > o. (4.9) 

k=l y 

Substituting AO]) . (TO and (EH} into (ESJ yields (Ojl . Substituting (lOjl . (Q]l and 

dSD into dUSD yields (Ojl . □ 

Lemma 8. For eac/i /Zmd model solution X, 

jV (t) < j2, l-A) + E fceJ (t)U { 2}^ ; (41Q) 
^ 2 C + EfceJ(t)U{2} 



1JW < ± _5 j _ J = li3 . (4 . n) 

^ 2 + 2^keJ(t)u{j} — k 



Proof. Let X be a fluid model solution. According to ([53]) . (I3T9|) . ( ETTUj) and (l3~T5|) - 
( I3.17p . we have 

Zftf) > ~^f;(t), ke J(t), 3 = 1,2,3, (4.12) 

T^t) = (3 k , fce{l,2,3}\ J{t). (4.13) 
According to (l3~9|) - (l3~T3|) and (l3~T5|) - (l3TT7l) . we have 

4 

> ^3(*)C-^(*)(C-C), J = 1,2,3, (4.14) 

fe=i 

4 

££>*(*) ^ f^ (t)c (4 - 15) 
fc=i 2 
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By fl3ZD, (J3IOD-03I5D, (GDI]) and gH, 

t,u>(t) > ^m^ + r^- (4 - 16) 

k=i i 2 

Substituting (KWf . ( EES} and (13TT5]) into (JSTH]) yields f l4TTUj) . Substituting (KWf . 
( jUSD and ( glSD into Q yields flCT]) . □ 



Lemma 9. For each augmented fluid model solution X, 

h 1 - Po + 02 



Proof. Let X be an augmented fluid model solution. By (13. 151) - (13.171) and (13.231) - 
(13T25D . we have Q k (t) = 0, k = 1, 2, 3, and, by fl33D . 

^(*) = t > 0, A: = 1,2,3. (4.19) 

By (ED and (EHUD and fl3T23D -f l3T25l) . 

4 

£t>*(t) > r^ (t)c (4 - 20) 
fc=i 2 



> ^(t)(-v,m)((-C), J = 1,3. (4.21) 



fc=l 



u 



Substituting KWf and pD| into leads to fKTTj) . Substituting (gUD and pi} 
into (GLED leads to (Qgj) . □ 

Now we are ready to prove Propositions (TJ [2] and [3j 

Proof of Proposition^ Suppose that H2. 21) . (12. 3 p and (12.41) are satisfied. For a fluid 
model solution X, let 

Then W^(t) = if and only if \Q(t)\ = 0. We prove that the fluid model is stable 
by showing that there is a 5 > such that for each fluid model solution X, with 
10(0)1 < 1, W(t) = for t > 5. The proof proceeds through 3 steps. 

Step 1. Let m be the number of indices j in {1,2,3} such that j- < and let 

ji, . . . ,j m be the indices enumerated so that y 21 < y 22 - < . . . < y^ 2 -. Then there exist 

tj 1 ij 2 ^ ij m ^ 

<5fc > 0, 1 < k < m, such that for each fluid model solution X with \Q(0)\ < 1, 

Qj{t) = fort> 5 k and j e {ji, . . . ,j k }- (4.22) 
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Proof. Let 5q = 0. For k = 0, (I4.22p holds trivially for each fluid model solution X 
with |Q(0)l < 1- F° r 1 < & < m, suppose that there exists 4-1 > such that, for each 
fluid model solution X with |Q(0)| < 1, Qjif) = for t > 4-i and j G {ji, . . . , jk-i}- 
Suppose that X is a fluid model solution with |Q(0)| < 1. According to ( I4.2p and 
(H3D, if Q jk {t) > 0, then 



1 - A) + EieJ(t) # 
S, + Z^eJ(t) 7T 



%(*) < ^"^ 



C + J2ieJ(t) ^ 

Since {ji, . . . ,jk-i} H J(£) = for t > 4-i, (I4.23P leads to 

z ifc (i- Po -^c) 
<&(t) < — — — — ift>5 fc _ ia ndQ Jfc (t)>o. 



(4.23) 



Hence 



where 



< -<*, if t > 4-1 and Q ih (t) > 0, 



e k = o — r — > 0. 

According to ( 13. 5ft and (13.71) . we have 

Qj k {8k-i) < l+A ifc (Jfc_i. 

Hence Qj k (t) = for t > 4, where 4 = 4-1 + 1+A ^' 5fc ~ 1 , The proof is completed by 
induction on k. □ 

.Step There exists an e > sitc/j /or eac/i /Ziud model solution X ; < — e 

> and Q 2 (t) = 0. 

Proof. It is easily proved that at least one of the following inequalities holds: 

Po + ^C < 1, J = 1,3, (4.24) 
Po + ^^^ + A 2 ^^ < 1, j = 1,3. (4.25) 
Let X be a fluid model solution. Suppose that W(t) > and Q2(t) = 0. By (13. 5p . 



fceJ(t) keJ(t) 
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First suppose that (14.241) holds. Substituting (144]) into (14.261) leads to 
W'{t) < ' " KeJ{t) M; 
Hence W'(t) < — e, where 



£* £ J (t)£(A) + y-l) 
C + EfeeJ(t) 



e = mm — = — > 0. 

^{{1},{3},{1,3}} C 

Next suppose that (OSjl holds. Substituting (l4~3j) into (l4~26j) leads to 



EfceJ(i) ^(Po + t£^- + - 1) 



+ Efe6j(t) ^ 

Hence W'(t) < — e, where 



( /« n n c+c* \ c-c* ' 



e = mm — „ , ; > 

±k_ 



A'e{{i},{3}, { i,3}} + £ fc ^ 

□ 



S'iep 5. There is a 5 > s«c/i t/iat ; /or eac/i /Zmei model solution X u>z£/i |Q(0)| < 1, 
= for t > 5. 

Proof. Suppose that X is a fluid model solution with |Q(0)| < 1. Then W(0) < 
maxi<fc<3 — . According to ( 13. 5ft and ( 13.71) . we have 



W(5 m ) < max — + p 5 m . 
l<fc<3 // fe 

By Steps 1 and 2, 

H/'(t) < -e, if t > 8 m and W(t) > 0. 
Hence Wit) = for t > 5, where 5 = 5 m + -(max 1<fc < 3 — + po5 m ). □ 

Proof of Proposition^ Suppose that at least one of ( 12.51) . ( 12.61) or (12. Tl) holds. Let 
X be an augmented fluid model solution with Q(0) = 0. By (pT5]l . (l4T7j) and ( l4~T8j) . 

we have 

1 - Po + Aj 



Q' 2 (t) > A 2 -/ 2 



l 2 (M(-l + p ) 



g'(t) > Aj - ij 



' "'3 ~ ~h~ 



1-po + h -^-^ 

■'3\"> " "J "3 C±C _j_ h_ 

2 W 

/ f A j C+C* i a 2 C-C* i , „ > 
hKj-^T- + J7— 1 + PoJ 

C+C* I h 

2 Mi 
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J = 1,3. 



Hence there exists j G {1,2,3} such that Qj(t) > for all t > 0, which implies that 
the augmented fluid model is weakly unstable. □ 

Proof of Proposition^ Suppose that at least one of the inequalities (I2.5p . (I2.6P or 
(12. 7p is strict. Let X be a fluid model solution with Q(0) = 0. 

First suppose that ^ > k = 1, 3. By fLSD and (ODjl . we have 

y 2 [t) > A 2 - t a — — ^ — 

S + 2^keJ(t)u{2} ^ 



> 



C + Efcej(t)u{2} £ 

> o, 

which implies that the fluid model is weakly unstable. 

Next suppose that there exists j E {1, 3} such that j- > jk, k = 1, 2, 3. By (13. 5p 
and (14. lip , we have 

Qj{t) > Xj — ij c+c | ^ 7T 



> 



2 r Z^feeJ(t)u{j} Mfc 

C-C 

J V U 2 1 « 2 2 



7 f a j C+C* I A 2 C-C* i I n 
h \ 73 2"" + 77^ 1 + Po 



2 + J2ke.J(t)u{j} Mfc 

> o, 

which implies that the fluid model is weakly unstable. □ 



5 Discussion on the fluid model for limited service 
disciplines and simulation results 

The upper and lower bounds for the fluid model equation (13.141) is not tight if l 2 > 1. 
From the fluid model equations (13.5p - fl3.17p . it can be observed that for each fluid 
model solution X, Q'(t) is determined by U' 4 (t), J(t), and the model parameters Xj, 
fij, lj, j = 1, 2, 3, and Uk, k = 1,2, 3, 4. 

For the case l 2 > 1, we conjecture that U±(t) is not determined by only J(t) and the 
model parameters but may also depend on the distributions of the driving sequences, 
the inter-arrival, the service and the switch-over times. 

To justify our conjecture, we present here two sets of simulation results for the 
fluid limits in the system with limited service disciplines. Specifically we observe fluid 
limits with Q 2 (t) = 0, Qi{t) > and Q 3 (t) = 0. 

We remind that the condition Q\{t) > in a fluid limit corresponds to the con- 
dition in the real system that the first queue is infinitely large and that during each 
visit to this queue the server serves exactly l\ customers. The goal is to find, in the 
long run, the fraction of time, M4, the server is in the switch-over regime from queue 
1 to queue 3, and the fraction of the number of the reduced cycles, p, among all. 
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5.1 First set of examples 

We present five simulation Examples where we vary only one of the distributions of 
the system (i.e. that of the inter-arrival times to queue 2). 

In the first three Examples, we are keeping the first moment fixed and show that 
both fractions may differ significantly. These examples illustrate that the stability 
conditions in the system under consideration are not determined, in general, by the 
first moments of the distributions of the primitive sequences. 

We go further and show by example that the knowledge of the first two moments 
is also not enough. We present Example 4 where the distribution of inter-arrival times 
to queue 2 have the same 1st and 2nd moments with exponential distribution from 
Example 3, but here also the fractions of interest significantly differ. 

Finally, we finish with showing that even the knowledge of the first three moments 
is insufficient. In Example 5, the distribution of inter-arrival times to queue 2 have 
the same the first, the second and the third moments with exponential distribution 
from Example 3, but again with different fractions of interest. 

So, our conjecture is that the fractions of interest may depend on the entirely 
whole distributions of the driving sequences, and the knowledge of any finite number 
of moments is not sufficient to determine the stability region precisely. 

We consider the following system parameters: 

1 2 

A2 = A 3 = -, vi = 2, 1/3 = 1, 1/4 = 3, v 2 = +00, 111 = 1, /x 3 = -, l 2 = 4, l 3 = 2. 

We let for simplicity u 2 = +00 that means that all switch-over times ^(^) are zeros. 
We further assume for simplicity that all (Ti(n) = too. 

We recall that M4 is the fraction of time when the server is switching from queue 

1 to queue 3, and that p is the fraction of the reduced cycles. In each of the following 
example, we run more than 10 8 cycles and find M4 and p with the error smaller than 

2 • 10~ 4 with probability greater than 0.9999. 

In what follows, a random variable with parameter, say C, "has a uniform distri- 
bution" means that it "has a uniform distribution on the interval (0, 2/C)". 

Example 1. We assume that all interarrival, service, and switch-over times are uni- 
formly distributed. We obtain U4 ~ 0.0466 and p w 0.1825. 

Example 2. We assume that the interarrival times to queue 2 have a probability 
density function f(x) = 8/x 3 , x > 2. The other primitive random variables are 
assumed to be uniformly distributed. Then we obtain w 4 ps 0, 0518, p ~ 0, 2027. 

Example 3. We assume that the interarrival times to queue 2 have an exponential 
distribution with mean 4- The other primitive random variables are assumed to be 
uniformly distributed. Then we obtain U4 ~ 0, 0619 and p ps 0, 2410. 

Example 4. We assume that the interarrival times to queue 2 have a probability 
density function f(x) = ba b /x b+1 , x > a with a = 8 — 4v^2 and 6=1 + The other 
primitive random variables are assumed to be uniformly distributed. Then we obtain 
m 4 ~ 0,0446 andptt 0,1751. 
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U.t:1UZi 


D 1 DQ1 
u. iuy i 


u.u 


^1 7Q 






n i^9^ 

u. ±uz,o 


D 041 ^ 

U.U4:10 


0.25 


0.4089 


0.1071 


0.7 


0.2953 


0.0763 


3 


0.1527 


0.0388 


0.30 


0.3982 


0.1041 


0.8 


0.2762 


0.0712 


4 


0.1417 


0.0360 


0.35 


0.3849 


0.1005 


0.9 


0.2602 


0.0670 


5 


0.1361 


0.0346 


0.40 


0.3713 


0.0969 


1 


0.2461 


0.0632 


10 


0.1272 


0.0322 


0.45 


0.3571 


0.0929 


1.25 


0.2198 


0.0563 


20 


0.1245 


0.0315 



Table 1: Simulation results for p and u 4 , varying the parameter a for the Weibull 
distribution. 

We remark that the first two moments (4 and 32 respectively) of the interarrival 
times to queue 2 coincide in Examples 3 and 4. However w 4 and p are significantly 
different. 

Example 5. We assume that the interarrival times for queue 2 have a discrete dis- 
tribution given by 

P(r 2 (l) = 4(2 - V2)) = 2 -±^>, P(r 2 (l) = 4(2 + ^2)) = 

The other primitive random variables are assumed to be uniformly distributed. Then 
we obtain w 4 m 0.0641 and p m 0.2494. 

We remark that the first three moments (4, 32 and 384 respectively) of the in- 
terarrival times to queue 2 coincide in Examples 3 and 5. However u 4 and p are 
different. 

5.2 Examples with Weibull distribution 

In this subsection, we again vary only the distribution of the interarrival times to 
queue 2. We focus on the class of Weibull distributions with a fixed mean. More 
precisely, we assume that the tail distribution function of the interarrival times for 
queue 2 is given by P(r 2 (l) > x) — exp(-fcr a ), x > 0, with b = (T(l + a _1 )/4) a . The 
other primitive random variables are assumed to be uniformly distributed. Note that 
Er 2 (l) = 4. Let l 2 = 6 and l 3 = 4. 

Tableland Fig. [1] present the simulation results for p and w 4 , varying the param- 
eter a for the Weibull distribution. The limiting value 0.1237 in Fig. [1] corresponds to 
the value of p when the interarrival times for queue 2 are 4, i.e., r 2 (n) = 4, n = 1, 2, . . ., 
with probability 1. We observe that the lighter is the tail of the Weibull distribution, 
the smaller are the values p and u 4 . 
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Figure 1: Simulation results for p, varying the parameter a for the Weibull distribu- 
tion. 



6 The fluid model and proof of Theorems H and [2 
for gated and exhaustive service disciplines 

In this section, we consider the polling system with either gated or exhaustive service 
disciplines. The fluid limits and the fluid limits with fixed initial states are defined as 
in Section [3j The following lemma can be shown by the standard procedure. 

Lemma 10. For every fluid limit X(£) = (Q(t),T(t),U(t)) , the following equations 
are satisfied: 

Qkit) = Q fc (0) + X k t - fji k f k (t), k = 1, 2, 3, t > 0; (6.1) 
Qk(t) >0, fc = l,2,3, t>0; (6.2) 
Tfc(-) and Uj(-) are nondecreasing, k = 1,2,3, j = 1,2,3,4; (6.3) 

3 4 

]Tf fc (t) + ]Tf/,(t)=t, t>0; (6.4) 

fc=l j=l 

3 

If\Q(t)\ > 0, then = 1, t>0. (6.5) 

fc=i 

For the polling system with either gated or exhaustive service disciplines, we 
call the equations ( I6.1jl - (l6.5jl the fluid model equations and call a solution X = 
{(Q(t),T(t),U(t)) : t > 0}, of the fluid model equations a fluid model solution. 

Using the similar argument as in the proof of Lemma HI we can prove the following 
result. 

Lemma 11. Suppose that the Markov process X is positive Harris recurrent, and a 
fluid limit with fixed initial state X(i) = (Q(t),T(t),U(t)) is driven from a sample 
path u that satisfies Ii3. 22\) . Then we have 

U' k (t) > 0, t > 0, k = 1,2,3,4. (6.6) 

We call the equations fl6.1l) - f)6.5p plus (16.61) the augmented fluid model equations 
and call a solution X, to these equations an augmented fluid model solution. 
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Definitions [T] and El and Lemmas El [3] and [5] can be applied to the polling systems 
with gated and exhaustive service disciplines. Therefore Theorems [1] and El for gated 
and exhaustive service disciplines are proved by Propositions HI |5] and [6] below. 

Proposition 4. For the polling system with gated or exhaustive service disciplines, 
the fluid model is stable if po < 1. 

Proof. For a fluid model solution X, let W(t) = J2l=i ^f 1 - B y HSU} and (153]) . 
= po - 1 if W(t) > 0. Hence the fluid model is stable if p < 1. □ 

Proposition 5. For £/ie polling system with gated or exhaustive service disciplines, 
the augmented fluid model is weakly unstable if p > 1 . 

Proof. For an augmented fluid model solution X, let W(t) = 5^fc=i By (16. ip . 

f)6.4p and (16. 6p . iy'(t) > p — 1. Hence the augmented fluid model is weakly unstable 
if po > 1- □ 

Proposition 6. For the polling system with gated or exhaustive service disciplines, 
the fluid model is weakly unstable if p > 1. 

Proof. For a fluid model solution X, let W(t) = £Li By (jBTT]) . (163]) and fl6^) . 

> Po — 1- Hence the fluid model is weakly unstable if p > 1. □ 
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